Skip to main content

Configuring Databricks to Upload Billing Data

Configuring Databricks to Upload Billing Data​

Follow these steps to configure Databricks to upload billing data to an S3 bucket for integration with the nOps platform.

note

If you already have a bucket that Databricks can upload files into, you don't need to follow this document.

Step 1: Create a new Bucket​

  • Log in to the AWS Management Console and navigate to the S3 service.
  • Click Create bucket.
  • Provide a unique bucket name, such as databricks-billing-data-{company-name}-nops.
  • Configure bucket permissions as required for your organization's security standards.
  • Click Create bucket.

Step 2: Grant Databricks Permissions Using an AWS Instance Profile​

To securely grant Databricks access to your S3 bucket, use an AWS Instance Profile. This method eliminates the need for access keys and improves security.

For detailed instructions, refer to the Databricks documentation on configuring S3 access with an instance profile.

Proceed to the Next Step​

Once the bucket is created and permissions are configured, you can proceed to the next step in the Integration Setup.